채점자 조정(calibration) 교육 제안을 위한 평가자 신뢰도 분석
Analysis of Evaluator Reliability for the Raters’ Calibration Training
김주아, 신유석, 서정택,
소속 상세정보
김주아 ( Kim Joo-Ah ) - Yonsei University College of Dentistry Department of Dental Education
신유석 ( Shin Yoo-Seok ) - Yonsei University College of Dentistry Department of Conservative Dentistry
서정택 ( Seo Jeong-Taeg ) - Yonsei University College of Dentistry Department of Oral Biology
KMID : 0362720200580050284
Abstract
This study analyzed the change in the rater reliability based on the student's practice evaluation process conducted at Yonsei University College of Dentistry. Through this, we suggest the significance of the rater calibration training in the student's practical evaluation of dental college. Nine professors from the department of Conservative Dentistry, Yonsei University College of Dentistry, analyzed the results of class II restoration cases twice in 2017 and once in 2018. Intra Class Correlation (ICC) which is a statistic used to determine the consistency of raters with three or more scores, was also calculated. ICC values increased as raters participated in rater calibration meetings and grading experiences. This shows that the rater reliability is related to the grading experience and feedback from calibration meeting. Based on the results of previous studies that grading experiences and rater calibration training can cause a meaningful change in rater behavior, we propose to conduct rater calibration training to ensure the evaluator reliability
키워드
reliability; rater calibration; intra-class correlation
원문 및 링크아웃 정보
등재저널 정보